Image processing apparatus, image capturing apparatus, and method of controlling the same

ABSTRACT

The present invention provides an image processing apparatus for performing image processing of image data in which information specifying, on a first coordinate system, a position of a portion of interest in an image is recorded, including an image processing unit configured to perform rotation processing of the image data using a second coordinate system having an origin different from that of the first coordinate system, and a change unit configured to change the information specifying the position of the portion of interest in accordance with a rotation amount of the image data by the rotation processing such that an image of the portion of interest specified by the information specifying the position of the portion of interest after the rotation processing matches that before the rotation processing.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of application Ser. No. 13/005,367,filed Jan. 12, 2011 the entire disclosure of which is herebyincorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing apparatus, imagecapturing apparatus, and method of controlling the same.

2. Description of the Related Art

There is known a function of, when reproducing (displaying) an imagecaptured by an image capturing apparatus on an image processingapparatus (image processing application software), displaying distancemeasuring frames (to be referred to as “AF frames” hereinafter) used forauto focus (AF) at the time of image capturing. For example, JapanesePatent Laid-Open No. 2000-125178 proposes a technique of recording, inan image (image data), the position information of an AF frame (to bereferred to as an “in-focus AF frame” hereinafter) used to bring anobject into focus and displaying the in-focus AF frame at the time ofimage reproduction to facilitate confirming image focus. This techniquealso allows to automatically enlarge the image in the in-focus AF frame.

On the other hand, an image captured by the image capturing apparatussometimes tilts in the horizontal direction due to the influence of theposture of the image capturing apparatus. Rotation processing ofrotating the captured image to correct the tilt has been proposed as oneof image processes.

However, when the image is rotated, and the in-focus AF frame isdisplayed directly using the position information of the AF framerecorded in the image, the in-focus AF frame is displayed in the rotatedimage at a position shifted from the actual in-focus AF frame position.

The problem of the prior art will be described in detail with referenceto FIGS. 5A and 5B. FIG. 5A is a view showing a display example in whichan in-focus AF frame is displayed in an image IM1 (that is, an imagebefore rotation processing) that tilts in the horizontal direction.Referring to FIG. 5A, nine rectangular frames represent AF frames FL1selectable at the time of image capturing. Out of the nine rectangularframes, a rectangular frame indicated by a bold line represents anin-focus AF frame FL2 used to focus on (the face of) an object OB by theAF function.

FIG. 5B is a view showing a display example in which the in-focus AFframe is displayed in an image IM2 obtained by performing rotationprocessing for the image IM1 shown in FIG. 5A so as to set the object OBin a horizontal position. Referring to FIG. 5B, an image IM3 is obtainedby cutting out, from the image IM2 after the rotation processing, aregion inscribed in the image region of the image IM2 not to include anyimage region absent in the image IM1 before the rotation processing. Theposition of the object OB in the image IM2 that has undergone therotation processing is shifted from its position in the image IM1 beforethe rotation processing. The AF frames FL1 and the in-focus AF frame FL2are displayed in the image IM3 using position information cut out uponcutting out the image IM3 from the image IM2.

As described above, when the AF frames FL1 and the in-focus AF frame FL2are displayed in the image IM3 directly using the position informationrecorded in the image IM1, the in-focus AF frame FL2 is displayed at aposition shifted from the position of the face of the object OB (actualin-focus AF frame position) in the image IM3.

SUMMARY OF THE INVENTION

The present invention provides a technique capable of displaying, in animage after rotation processing, a portion of interest at the sameposition as that in the image before the rotation processing.

According to one aspect of the present invention, there is provided animage processing apparatus for performing image processing of image datain which information specifying, on a first coordinate system, aposition of a portion of interest in an image is recorded, comprising:an image processing unit configured to perform rotation processing ofthe image data using a second coordinate system having an origindifferent from that of the first coordinate system; and a change unitconfigured to change the information specifying the position of theportion of interest in accordance with a rotation amount of the imagedata by the rotation processing such that an image of the portion ofinterest specified by the information specifying the position of theportion of interest after the rotation processing matches that beforethe rotation processing.

Further aspects of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram showing an image capturing apparatusaccording to an embodiment of the present invention.

FIG. 2 is a flowchart for explaining image data rotation processing inthe image capturing apparatus shown in FIG. 1.

FIGS. 3A and 3B are views showing display examples in which AF framesare displayed in an image obtained by performing rotation processing foran image shown in FIG. 5A so as to set an object in a horizontalposition according to the embodiment.

FIG. 4 is a flowchart for explaining display control processing in theimage capturing apparatus shown in FIG. 1.

FIGS. 5A and 5B are views for explaining a problem of a prior art.

DESCRIPTION OF THE EMBODIMENTS

Preferred embodiments of the present invention will be described belowwith reference to the accompanying drawings. Note that the samereference numerals denote the same members throughout the drawings, anda repetitive description thereof will not be given.

FIG. 1 is a schematic block diagram showing an image capturing apparatus100 according to an embodiment of the present invention. The imagecapturing apparatus 100 is an image capturing apparatus for capturing anobject and is implemented as a digital camera in this embodiment. Theimage capturing apparatus 100 records image data corresponding to acaptured image in an external storage device 200 connected to the imagecapturing apparatus 100, and also displays (reproduces) an imagecorresponding to image data recorded in the external storage device 200.

An imaging lens 102 forms an image of light L from an object (that is,forms an optical image) on the imaging plane of an image sensor 108. Theimage sensor 108 is formed from, for example, a CCD or CMOS device(photoelectric conversion device), and converts an optical image formedthrough the imaging lens 102, stop 104, and shutter 106 into anelectrical signal. An A/D conversion unit 110 converts an analog signal(analog data) output from the image sensor 108 into a digital signal(digital data). A timing generation unit 112 supplies clock signals andcontrol signals to the image sensor 108, A/D conversion unit 110, andD/A conversion unit 114 and controls their operations under the controlof a memory control unit 118 and a system control unit 142.

An image processing unit 116 performs various kinds of processing fordata input from the A/D conversion unit 110 or data input from thememory control unit 118. For example, the image processing unit 116performs white balance processing, color correction processing, rotationprocessing, dust detection processing of detecting dust sticking to theimage sensor 108, dust erase processing of making such dustunnoticeable, and the like. Note that rotation processing rotates imagedata using a coordinate system (second coordinate system) having anorigin different from that of the coordinate system (first coordinatesystem) of the image data before rotation processing so as to correct atilt.

The memory control unit 118 controls the A/D conversion unit 110, timinggeneration unit 112, D/A conversion unit 114, image processing unit 116,image display memory 120, memory 122, and compression/decompression unit124. The digital signal A/D-converted by the A/D conversion unit 110 isrecorded (written) in the image display memory 120 or the memory 122 viathe image processing unit 116 and the memory control unit 118 or via thememory control unit 118.

The image display memory 120 stores image data corresponding to an imagedisplayed on a display unit 126. The memory 122 stores image data (forexample, still image data and moving image data captured by the imagecapturing apparatus 100), and has a storage capacity capable of storinga predetermined number of image data. The memory 122 is also usable asthe work area of the image processing unit 116 or the system controlunit 142.

The compression/decompression unit 124 reads out image data from thememory 122 and compresses it, or reads out compressed image data fromthe memory 122 and decompresses it, and records the processed image datain the memory 122.

The display unit 126 includes a TFT (Thin Film Transistor) or an LCD(Liquid Crystal Display), and displays, via the D/A conversion unit 114,an image corresponding to image data stored in the image display memory120. The display unit 126 also displays various kinds of menu screens(for example, a menu screen to be used to set rotation processing) tocontrol the image capturing apparatus 100. Display of these menu screensor setting and selection on the menu screens are done by a useroperation on an operation unit 152.

A photometry sensor 128 detects the luminance of each pixel conjugate tothe imaging plane of the image sensor 108 and inputs it to the systemcontrol unit 142. The system control unit 142 calculates an appropriateexposure amount corresponding to the detection result of the photometrysensor 128. An exposure control unit 130 controls the stop 104 and theshutter 106 based on the exposure amount calculated by the systemcontrol unit 142.

A distance measuring sensor 132 detects the distance information of adistance measuring point (AF frame) arbitrarily selected by the user.However, the distance measuring point need not always be arbitrarilyselected by the user, and may be set to automatically focus on an objectin the shortest distance based on the detection result of the distancemeasuring sensor 132. A distance measuring control unit 134 controlsfocusing of the imaging lens 102 based on the detection result of thedistance measuring sensor 132.

A zoom control unit 136 detects the zooming amount (focal length) of theimaging lens 102 manually operated by the user. When the imaging lens102 automatically zooms, the zoom control unit 136 controls the zoomingamount of the imaging lens 102. An electronic flash unit 138 has an AFauxiliary light projecting function and an electronic flash brightnesscontrol function. An angular velocity sensor 140 detects horizontal andvertical shakes of the image capturing apparatus 100, and is used forcamera shake correction processing or portrait/landscape image capturingdetermination.

The system control unit 142 controls the entire image capturingapparatus 100. The system control unit 142 executes programs stored in anonvolatile memory 144 to execute the processing of this embodiment. Thenonvolatile memory 144 is a memory capable of electrically erasing andrecording data and includes, for example, an EEPROM. The nonvolatilememory 144 stores constants and programs (programs to be used to executevarious flowcharts to be described later) for the operation of thesystem control unit 142. A system memory 146 is formed from, forexample, a RAM and rasterizes the constants and variables for theoperation of the system control unit 142 and programs read out from thenonvolatile memory 144.

An output unit 148 includes a display device which displays theoperation states of the image capturing apparatus 100 and messages bytexts or images and a speaker which outputs them by voices in accordancewith program execution in the system control unit 142. The output unit148 displays single shooting/sequential shooting, timer, compressionratio, number of recording pixels, number of recorded images, and numberof recordable images. The output unit 148 also displays the shutterspeed, F-number, exposure compensation, battery level, error, and theattached/detached state of the external storage device 200.

A release button 150 is used to instruct to capture an object andincludes a first switch and a second switch. When the release button 150is operated (pressed) halfway, the first switch is turned on to supply asignal for starting photometry processing or distance measuringprocessing to the system control unit 142. When the release button 150is operated (pressed) fully, the second switch is turned on to supply asignal for starting exposure processing to the system control unit 142.

The operation unit 152 includes setting buttons, selection buttons, anda touch panel provided on the display unit 126, and has a function ofaccepting user operations (inputting various kinds of instructions tothe system control unit 142). The operation unit 152 is used for, forexample, single shooting/sequential shooting/self timer switching andsetting of the shutter speed, F-number, and exposure compensation.

A power switch 154 is used to switch the power state of the imagecapturing apparatus 100 between an ON state and an OFF state. A powersupply control unit 156 includes a battery detection circuit, DC/DCconverter, and switching circuit for switching a block to be energized,and detects the presence/absence of a battery attached to a power supplyunit 158, the type of battery, and the battery level. Additionally, thepower supply control unit 156 controls the DC/DC converter based on thedetection result in the power supply unit 158 and an instruction fromthe system control unit 142 so as to supply a necessary voltage to theunits of the image capturing apparatus 100 including the externalstorage device 200 during a necessary period. The power supply unit 158detachably holds a primary cell such as an alkaline cell or a lithiumcell, a secondary cell such as an NiCd cell, NiMH cell, or Li cell, oran AC adapter, and outputs a voltage (DC voltage).

The external storage device 200 is a storage medium detachable from theimage capturing apparatus 100, and includes a CF (Compact Flash®) cardand an SD card. Image data temporarily recorded in the memory 122 isfinally recorded in the external storage device 200.

Various kinds of processing (operations) of the image capturingapparatus 100 will be described below. Rotating an image correspondingto image data recorded in the external storage device 200, that is,image data rotation processing in the image capturing apparatus 100 willbe described first with reference to FIG. 2. Image data recorded in theexternal storage device 200 can be either image data generated by theimage capturing apparatus 100 or image data generated by another imagecapturing apparatus. Information specifying (on the first coordinatesystem) the position of a portion of interest in the image is recordedin (the image header field of) the image data.

In step S202, the system control unit 142 reads out image data from theexternal storage device 200 to the image display memory 120. At thistime, the system control unit 142 displays, on the display unit 126, animage corresponding to the image data read out to the image displaymemory 120. The image displayed on the display unit 126 can be switchedby a user operation (for example, a user operation on the operation unit152 to input an image switching instruction). That is, upon receiving animage switching instruction, the system control unit 142 reads outanother image data from the external storage device 200 to the imagedisplay memory 120 and displays an image corresponding to the image dataon the display unit 126.

In step S204, the system control unit 142 selects process target imagedata to be subjected to rotation processing from the image data read outin step S202 in accordance with a user operation (for example, a useroperation on the operation unit 152 to input an image selectioninstruction).

In step S206, the system control unit 142 decides the image datarotation amount of image processing (image data rotation amountnecessary for correcting the tilt of the image). For example, the systemcontrol unit 142 decides the image data rotation amount in accordancewith a user operation. At this time, the system control unit 142instructs the image processing unit 116 to rotate the image data basedon the rotation amount input by the user and displays, on the displayunit 126, an image corresponding to the image data rotated by the imageprocessing unit 116. Hence, the user can confirm the image displayed onthe display unit 126 while increasing/decreasing the image data rotationamount to be input and finally decide the image data rotation amount.

In step S208, the system control unit 142 instructs the image processingunit 116 to perform rotation processing of the image data selected instep S204 based on the rotation amount decided in step S206 so that theimage processing unit 116 performs image data rotation processing. Notethat the image data rotation processing can be implemented by a rotationprocessing algorithm known to those skilled in the art, and a detaileddescription thereof will be omitted.

In step S210, the system control unit 142 obtains, from the image dataselected in step S204, information specifying the position of a portionof interest in the image. Examples of the portion of interest are aportion corresponding to a distance measuring frame (AF frame) for autofocus, a portion corresponding to the face (including eyes, nose, andmouth) of an object detected by face detection processing, and a portioncorresponding to a dust particle sticking to the image sensor 108 anddetected by dust detection processing. Note that the AF frames includeat least one of an AF frame selectable upon generating image data and anAF frame (in-focus AF frame) used to bring the object into focus at thetime of image data generation.

In step S212, the system control unit 142 changes the informationspecifying the position of the portion of interest in accordance withthe rotation amount decided in step S206 such that the image of theportion of interest specified by the information specifying the positionof the portion of interest after the rotation processing (S208) matchesthat before the rotation processing.

Step S212 will be described in detail. Assume that the portion ofinterest is an AF frame selectable upon image data generation or anin-focus AF frame used to bring the object into focus at the time ofimage data generation. The AF frame generally has a rectangular shape,as shown in FIGS. 5A and 5B. Hence, in this embodiment, the informationspecifying the position of the portion of interest, that is, the AFframe includes four coordinate points representing the positions of thefour vertices of the rectangular shape of the AF frame so as torepresent the position and size of the AF frame. Note that theinformation specifying the position of the AF frame may be onecoordinate point representing the position of one point (for example,one of the four vertices of the rectangular shape or the central pointof the rectangular shape) included in the AF frame (distance measuringframe). In this case, however, the image data needs to recordinformation representing the rectangular shape based on the onecoordinate point. If there are nine AF frames selectable in the imagecapturing apparatus at the time of image data generation, as shown inFIGS. 5A and 5B, the above-described four coordinate points representingthe positions of four vertices are included for each of the nine AFframes.

The system control unit 142 obtains the above-described four coordinatepoints representing the positions of the four vertices (S210), andchanges the four coordinate points serving as the information specifyingthe position of the portion of interest by the same processing as theimage data rotation processing of the image processing unit 116. Thisallows to display the AF frame at the actual AF frame position (theposition of the AF frame in the image before the rotation processing)even in the image that has undergone the rotation processing.

In step S214, the system control unit 142 records the informationspecifying the position of the portion of interest, which is changed instep S212, in (the image header field of) the image data.

Note that in this embodiment, the information specifying the position ofan AF frame serving as a portion of interest includes four coordinatepoints representing the positions of the four vertices of therectangular shape of the AF frame, and each of the four coordinatepoints is changed based on the rotation amount decided in step S206 andrecorded in the image data. Hence, each AF frame is displayed in therotated image using the four coordinate points recorded in step S214, asshown in FIG. 3A. FIG. 3A is a view showing a display example in whichAF frames FL1 and an in-focus AF frame FL2 are displayed in an image IM5obtained by performing rotation processing for an image IM1 shown inFIG. 5A so as to set an object OB in a horizontal position. Referring toFIG. 3A, an image IM6 is obtained by cutting out, from the image IM5after the rotation processing, a region inscribed in the image region ofthe image IM5 not to include any image region absent in the image IM1before the rotation processing. Note that when cutting out the image,the information specifying the position of the portion of interestrecorded in the image data is also shifted in accordance with imagecutout. As shown in FIG. 3A, each of the AF frames FL1 and the in-focusAF frame FL2 is displayed in the image IM5 using the four coordinatepoints changed based on the rotation amount decided in step S206. Hence,the AF frames FL1 and the in-focus AF frame FL2 are displayed at theactual positions (the positions of the AF frames in the image before therotation processing) in a state rotated based on the rotation amount.

On the other hand, when the information specifying the position of an AFframe includes one coordinate point representing the position of onepoint included in the AF frame, only the one coordinate point is changedbased on the rotation amount decided in step S206 and recorded in theimage data. Hence, each AF frame is displayed in the rotated image usingthe one coordinate point recorded in step S214 and informationrepresenting the rectangular shape based on the one coordinate pointrecorded in the image, as shown in FIG. 3B. FIG. 3B is a view showing adisplay example in which the AF frames FL1 and the in-focus AF frame FL2are displayed in an image IM7 obtained by performing rotation processingfor the image IM1 shown in FIG. 5A so as to set the object OB in ahorizontal position. Referring to FIG. 3B, an image IM8 is obtained bycutting out, from the image IM7 after the rotation processing, a regioninscribed in the image region of the image IM7 not to include any imageregion absent in the image IM1 before the rotation processing. As shownin FIG. 3B, each of the AF frames FL1 and the in-focus AF frame FL2 isdisplayed in the image IM7 using the one coordinate point changed basedon the rotation amount decided in step S206 and the informationrepresenting the rectangular shape based on the one coordinate point.Hence, the AF frames FL1 and the in-focus AF frame FL2 are displayed atthe actual positions (the positions of the AF frames in the image beforethe rotation processing). However, since the information representingthe rectangular shape based on one coordinate point has not changedbased on the rotation processing (rotation amount), the AF frames FL1and the in-focus AF frame FL2 are displayed in the image IM7 withoutbeing rotated, resulting in display with a sense of incongruity. Todisplay rotated AF frames in the rotated image, the system control unit142 records the rotation amount decided in step S206 in (the imageheader field of) the image data in step S216. This enables to displaythe AF frames rotated based on the rotation amount decided in step S206.Note that when the information specifying the position of an AF frameincludes four coordinate points representing the positions of the fourvertices of the rectangular shape of the AF frame, the AF frame can bedisplayed while being rotated using the four coordinate points recordedin step S214, as described above. Hence, recording the rotation amountdecided in step S206 in the image data, that is, step S216 needs not beperformed.

In step S218, the system control unit 142 records, in the externalstorage device 200, the image data which has recorded the informationspecifying the position of the portion of interest, which is changed instep S212, (and the rotation amount decided in step S206).

Note that in this embodiment, rotation processing of image data recordedin the external storage device 200 has been described. However, thepresent invention is not limited to this. For example, rotationprocessing may be performed before recording image data in the externalstorage device 200. In this case, the image data rotation amount isdecided using the detection result of the angular velocity sensor 140,and information specifying the position of the portion of interest ischanged based on the rotation amount and recorded in the image data, asdescribed above.

Reading out image data stored in the external storage device 200 anddisplaying an image corresponding to the image data on the display unit126, that is, display control processing in the image capturingapparatus 100 will be described next with reference to FIG. 4.

In step S402, the system control unit 142 reads out image data from theexternal storage device 200 to the image display memory 120.

In step S404, the system control unit 142 determines whether a functionof displaying a portion of interest (for example, AF frame) of the imageis set. The function of displaying the portion of interest of the imageis set by a user operation on the operation unit 152. When the functionof displaying the portion of interest of the image is set, for example,a portion-of-interest display function flag is validated. The systemcontrol unit 142 can determine, by referring to the portion-of-interestdisplay function flag, whether the function of displaying the portion ofinterest of the image is set. If the function of displaying the portionof interest of the image is set, the process advances to step S406. Ifthe function of displaying the portion of interest of the image is notset, the process advances to step S410.

In step S406, the system control unit 142 obtains information specifyingthe position of the portion of interest from the image data read out instep S402. If the image data rotation amount and other information (forexample, information representing a rectangular shape based on onecoordinate point) are recorded in the image data, these pieces ofinformation are also obtained.

In step S408, the system control unit 142 generates portion-of-interestdisplay data (for example, data representing a rectangular AF frameserving as the portion of interest) based on the information specifyingthe position of the portion of interest obtained in step S406 andrecords it in (the image header field of) the image data. If the imagedata rotation amount and other information have also been obtained instep S406, the portion-of-interest display data is generated based onthe information specifying the position of the portion of interest, therotation amount, and other information.

In step S410, the system control unit 142 displays the image on thedisplay unit 126. If the function of displaying the portion of interestof the image is not set, the image corresponding to the image data readout in step S402 is directly displayed (that is, the portion of interestis not displayed). On the other hand, if the function of displaying theportion of interest of the image is set, the image corresponding to theimage data read out in step S402 is displayed. In addition, the portionof interest corresponding to the portion-of-interest display datarecorded in step S408 is displayed in the image. In this case, even whenthe image data has undergone rotation processing, the informationspecifying the position of the portion of interest recorded in the imagedata is changed based on the image data rotation amount, as describedabove. Hence, as shown in FIG. 3A, the portion of interest can bedisplayed at the actual position in the image after the rotationprocessing while being rotated based on the image data rotation amount.

In step S412, the system control unit 142 determines whether aninstruction is input to enlarge the image of the portion of interest inthe image displayed in step S410. Note that the instruction to enlargethe image of the portion of interest is input by a user operation on theoperation unit 152. If the instruction to enlarge the image of theportion of interest is not input, the display control processing ends.On the other hand, if the instruction to enlarge the image of theportion of interest is input, the system control unit 142 enlarges theimage of the portion of interest and displays it in step S414. Anyenlarging method known to those skilled in the art is applicable toenlarge the image of the portion of interest, and a detailed descriptionthereof will be omitted.

Note that if the portion of interest is a portion corresponding to adust particle sticking to the image sensor 108, the system control unitmay determine in step S412 whether a dust erase processing instructionis input so that dust erase processing is performed in step S414.

As described above, according to the image capturing apparatus 100 ofthis embodiment, when performing rotation processing of image data,information specifying the position of a portion of interest, which isrecorded in the image data, is also changed based on the image datarotation amount. This makes it possible to display, in an image afterrotation processing, a portion of interest at the same position as thatin the image before the rotation processing.

In this embodiment, image data rotation processing in an image capturingapparatus has been described. However, the present invention is notlimited to this. The present invention can also be implemented in animage processing apparatus (image processing application software) suchas a personal computer.

Aspects of the present invention can also be realized by a computer of asystem or apparatus (or devices such as a CPU or MPU) that reads out andexecutes a program recorded on a memory device to perform the functionsof the above-described embodiments, and by a method, the steps of whichare performed by a computer of a system or apparatus by, for example,reading out and executing a program recorded on a memory device toperform the functions of the above-described embodiments. For thispurpose, the program is provided to the computer for example via anetwork or from a recording medium of various types serving as thememory device (for example, computer-readable medium).

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

This application claims the benefit of Japanese Patent application No.2010-024832 filed on Feb. 5, 2010, which is hereby incorporated byreference herein in its entirety.

What is claimed is:
 1. An image processing apparatus for performingimage processing of image data in which information specifying aposition of a portion of interest in an image is recorded, comprising:an image processing unit configured to perform rotation processing ofthe image data; a change unit configured to change the informationspecifying the position of the portion of interest in accordance with arotation amount of the image data by the rotation processing such thatan image of the portion of interest specified by the informationspecifying the position of the portion of interest after the rotationprocessing is corresponding to that before the rotation processing,wherein the portion of interest is corresponding to a portion which wasused to prepare for taking the image.
 2. The apparatus according toclaim 1, wherein the change unit changes the information specifying theposition of the portion of interest in accordance with a rotation amountof the image data by the rotation processing.
 3. The apparatus accordingto claim 1, further comprising a display control unit configured tocontrol to display the image of the portion of interest in addition todisplaying an image corresponding to the image data.
 4. The apparatusaccording to claim 1, wherein the image data is generated by an imagecapturing apparatus, and the portion of interest is a portioncorresponding to a frame for auto focus, the frame is selectable in theimage capturing apparatus upon generating the image data.
 5. Theapparatus according to claim 1, wherein the image data is generated byan image capturing apparatus, and the portion of interest is a portioncorresponding to a frame for auto focus, the portion is used to focus onan object by the image capturing apparatus upon generating the imagedata.
 6. The apparatus according to claim 1, wherein the informationspecifying the position of the portion of interest has a rectangularshape.
 7. The apparatus according to claim 1, further comprising adisplay control unit configured to, when displaying, on a display unit,an image corresponding to the image data which has undergone therotation processing, display distance image in according to the positionof the portion of interest.
 8. The apparatus according to claim 1,further comprising a display control unit configured to control todisplay the image of the portion of interest, wherein said displaycontrol unit rotates the frame in accordance with the rotation amount ofthe image data by the rotation processing.
 9. An image capturingapparatus comprising: an image capturing unit configured to capture anobject to generate image data; and an image processing apparatus ofclaim 1 which performs image processing of the image data generated bysaid image capturing unit.
 10. A method of controlling an imageprocessing apparatus for performing image processing of image data inwhich information specifying a position of a portion of interest in animage is recorded, comprising: performing rotation processing of theimage data; and changing the information specifying the position of theportion of interest in accordance with a rotation amount of the imagedata by the rotation processing such that an image of the portion ofinterest specified by the information specifying the position of theportion of interest after the rotation processing is corresponding tothat before the rotation processing, wherein the portion of interest iscorresponding to a portion which was used to prepare for taking theimage.
 11. The method according to claim 10, wherein the changing stepchanges the information specifying the position of the portion ofinterest in accordance with a rotation amount of the image data by therotation processing.
 12. The method according to claim 10, furthercomprising controlling to display the image of the portion of interestin addition to displaying an image corresponding to the image data. 13.The method according to claim 10, wherein the image data is generated byan image capturing apparatus, and the portion of interest is a portioncorresponding to a frame for auto focus, the frame is selectable in theimage capturing apparatus upon generating the image data.
 14. The methodaccording to claim 10, wherein the image data is generated by an imagecapturing apparatus, and the portion of interest is a portioncorresponding to a frame for auto focus, the portion is used to focus onan object by the image capturing apparatus upon generating the imagedata.
 15. The method according to claim 10, wherein the informationspecifying the position of the portion of interest has a rectangularshape.
 16. The method according to claim 10, further comprising, whendisplaying, on a display unit, an image corresponding to the image datawhich has undergone the rotation processing, displaying distance imagein according to the position of the portion of interest.
 17. The methodaccording to claim 10, further comprising controlling to display theimage of the portion of interest, wherein the controlling step rotatesthe frame in accordance with the rotation amount of the image data bythe rotation processing.
 18. A non-transitory computer-readable storagemedium storing a program for causing a computer to execute a method ofcontrolling an image processing apparatus for performing imageprocessing of image data in which information specifying a position of aportion of interest in an image is recorded, the program causing thecomputer to execute: performing rotation processing of the image data;and changing the information specifying the position of the portion ofinterest in accordance with a rotation amount of the image data by therotation processing such that an image of the portion of interestspecified by the information specifying the position of the portion ofinterest after the rotation processing is corresponding to that beforethe rotation processing, wherein the portion of interest iscorresponding to a portion which was used to prepare for taking theimage.
 19. The medium according to claim 18, wherein the changing stepchanges the information specifying the position of the portion ofinterest in accordance with a rotation amount of the image data by therotation processing.
 20. The medium according to claim 18, wherein theprogram causing the computer to execute controlling to display the imageof the portion of interest in addition to displaying an imagecorresponding to the image data.
 21. The medium according to claim 18,wherein the image data is generated by an image capturing apparatus, andthe portion of interest is a portion corresponding to a frame for autofocus, the frame is selectable in the image capturing apparatus upongenerating the image data.
 22. The medium according to claim 18, whereinthe image data is generated by an image capturing apparatus, and theportion of interest is a portion corresponding to a frame for autofocus, the portion is used to focus on an object by the image capturingapparatus upon generating the image data.
 23. The medium according toclaim 18, wherein the information specifying the position of the portionof interest has a rectangular shape.
 24. The medium according to claim18, wherein the program causing the computer to execute, whendisplaying, on a display unit, an image corresponding to the image datawhich has undergone the rotation processing, displaying distance imagein according to the position of the portion of interest.
 25. The mediumaccording to claim 18, wherein the program causing the computer toexecute controlling to display the image of the portion of interest,wherein the controlling step rotates the frame in accordance with therotation amount of the image data by the rotation processing.
 26. Animage processing apparatus for performing image processing of image datain which information specifying a position of a portion of interest inan image is recorded, comprising: an image processing unit configured toperform rotation processing of the image data; a change unit configuredto change the information specifying the position of the portion ofinterest in accordance with a rotation amount of the image data by therotation processing such that an image of the portion of interestspecified by the information specifying the position of the portion ofinterest after the rotation processing is corresponding to that beforethe rotation processing, wherein the portion of interest is a portioncorresponding to a dust particle sticking.
 27. The apparatus accordingto claim 26, wherein the image data is generated by an image capturingapparatus, and the portion of interest is a portion corresponding to adust particle sticking to an image sensor of the image capturingapparatus.
 28. The apparatus according to claim 27, wherein said imageprocessing unit performs dust erase processing for the image data whichhas undergone the rotation processing so as to make the dust particleunnoticeable using the information specifying the position of theportion of interest changed by said change unit.
 29. A method ofcontrolling an image processing apparatus for performing imageprocessing of image data in which information specifying a position of aportion of interest in an image is recorded, comprising: performingrotation processing of the image data; and changing the informationspecifying the position of the portion of interest in accordance with arotation amount of the image data by the rotation processing such thatan image of the portion of interest specified by the informationspecifying the position of the portion of interest after the rotationprocessing is corresponding to that before the rotation processing,wherein the portion of interest is a portion corresponding to a dustparticle sticking.
 30. The method according to claim 29, wherein theimage data is generated by an image capturing apparatus, and the portionof interest is a portion corresponding to a dust particle sticking to animage sensor of the image capturing apparatus.
 31. The method accordingto claim 30, further comprising performing dust erase processing for theimage data which has undergone the rotation processing so as to make thedust particle unnoticeable using the information specifying the positionof the portion of interest changed in the changing step.
 32. Anon-transitory computer-readable storage medium storing a program forcausing a computer to execute a method of controlling an imageprocessing apparatus for performing image processing of image data inwhich information specifying a position of a portion of interest in animage is recorded, the program causing the computer to execute:performing rotation processing of the image data; and changing theinformation specifying the position of the portion of interest inaccordance with a rotation amount of the image data by the rotationprocessing such that an image of the portion of interest specified bythe information specifying the position of the portion of interest afterthe rotation processing is corresponding to that before the rotationprocessing, wherein the portion of interest is a portion correspondingto a dust particle sticking.
 33. The medium according to claim 18,wherein the image data is generated by an image capturing apparatus, andthe portion of interest is a portion corresponding to a dust particlesticking to an image sensor of the image capturing apparatus.
 34. Themedium according to claim 33, wherein the program causing the computerto execute processing for the image data which has undergone therotation processing so as to make the dust particle unnoticeable usingthe information specifying the position of the portion of interestchanged in the changing step.